Papers with automated gameplay evaluator
FlashAdventure: A Benchmark for GUI Agents Solving Full Story Arcs in Diverse Adventure Games (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing game benchmarks lack diversity and evaluate GUI agents on completing entire storylines. |
| Approach: | They propose a benchmark of 34 Flash-based adventure games to test full story arc completion and tackle observation-behavior gap. |
| Outcome: | The proposed benchmarks show GUI agents struggle with full story arc completion while others improve on observation-behavior gaps. |